Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7fd14d6f580eeed46ef4d6f04f6b5f2f1318c0f9 (+ 153 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/9f98cfa51b416a2b40884b7d5202eb4daa801ec0 (+ 127 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=103a469dc7755fd9e8ccf362f3dd4c55dc761908 (+ 15 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=41ef90ef3d60f744371a36bff5b5c8fbe78099d7 (+ 196 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-gnu-arm-master-Os_LTO-build/3/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0003 (4-changed-components) 2023-01-13T06:38:13 0:00:00
Previous 0002 (4-changed-components) 2023-01-02T11:55:15 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 56 159
Performance Improvements 129 51
Unchanged Tests 1051 1026
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
410.bwaves 4.64% 14437.000 15107.000 - 2.46% -
471.omnetpp 1.05% 11193.000 11310.000 - 22.07% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) 586.15% 0.650 4.460 - 333.01% -
437.leslie3d (unexplained diff vs previous) 553.78% 119.000 778.000 - 316.04% -
447.dealII (unexplained diff vs previous) 335.59% 59.000 257.000 - 277.94% -
447.dealII (unexplained diff vs previous) (percentage) 335.38% 0.650 2.830 - 277.33% -
410.bwaves (max) 230.23% 301.000 994.000 - 282.31% -
410.bwaves (max) (percentage) 214.83% 2.090 6.580 - 271.75% -
410.bwaves (unexplained diff vs previous) 202.92% 308.000 933.000 - 263.04% -
410.bwaves (unexplained diff vs previous) (percentage) 190.14% 2.130 6.180 - 255.17% -
436.cactusADM (unexplained diff vs previous) 118.33% 540.000 1179.000 - 0.51% -
436.cactusADM (unexplained diff vs previous) (percentage) 117.51% 2.170 4.720 - -1.87% -
447.dealII (max) 84.67% 137.000 253.000 - 68.67% -
447.dealII (max) (percentage) 83.55% 1.520 2.790 - 69.09% -
437.leslie3d (max) (percentage) 46.74% 2.910 4.270 - 37.74% -
437.leslie3d (max) 40.64% 529.000 744.000 - 32.86% -
447.dealII 38.96% 77.000 107.000 - 35.44% -
447.dealII (avg) 38.96% 77.000 107.000 - 35.44% -
447.dealII (avg) (percentage) 37.21% 0.860 1.180 - 35.63% -
410.bwaves 20.07% 284.000 341.000 - 17.99% -
410.bwaves (avg) 20.07% 284.000 341.000 - 17.99% -
436.cactusADM (max) 17.92% 1049.000 1237.000 - 0.49% -
436.cactusADM (max) (percentage) 17.81% 4.210 4.960 - -1.78% -
416.gamess (unexplained diff vs previous) (percentage) 17.70% 2.430 2.860 - -6.23% -
416.gamess (unexplained diff vs previous) 17.31% 699.000 820.000 - -8.48% -
410.bwaves (avg) (percentage) 14.72% 1.970 2.260 - 15.31% -
436.cactusADM 11.93% 595.000 666.000 - 13.85% -
436.cactusADM (avg) 11.93% 595.000 666.000 - 13.85% -
436.cactusADM (avg) (percentage) 11.72% 2.390 2.670 - 11.25% -
416.gamess (avg) (percentage) 10.59% 1.700 1.880 - 13.94% -
416.gamess 10.25% 488.000 538.000 - 10.93% -
416.gamess (avg) 10.25% 488.000 538.000 - 10.93% -
401.bzip2 (avg) (percentage) 8.62% 0.580 0.630 - 133.33% -
401.bzip2 8.51% 94.000 102.000 - 126.67% -
401.bzip2 (avg) 8.51% 94.000 102.000 - 126.67% -
444.namd 7.55% 437.000 470.000 - 13.53% -
444.namd (avg) 7.55% 437.000 470.000 - 13.53% -
444.namd (avg) (percentage) 7.41% 2.970 3.190 - 22.69% -
434.zeusmp (avg) (percentage) 7.41% 1.350 1.450 - 18.85% -
434.zeusmp 7.24% 290.000 311.000 - 21.96% -
434.zeusmp (avg) 7.24% 290.000 311.000 - 21.96% -
400.perlbench 6.38% 47.000 50.000 - 16.28% -
400.perlbench (avg) 6.38% 47.000 50.000 - 16.28% -
433.milc 6.19% 113.000 120.000 - 27.66% -
433.milc (avg) 6.19% 113.000 120.000 - 27.66% -
437.leslie3d (avg) (percentage) 5.00% 1.600 1.680 - 0.60% -
400.perlbench (avg) (percentage) 4.65% 0.430 0.450 - 15.38% -
433.milc (avg) (percentage) 4.65% 0.860 0.900 - 30.43% -
416.gamess (max) (percentage) 2.43% 2.880 2.950 - -6.05% -
416.gamess (max) 2.18% 826.000 844.000 - -8.56% -
459.GemsFDTD (avg) (percentage) 1.79% 1.680 1.710 - 23.02% -
435.gromacs (avg) (percentage) 1.35% 1.480 1.500 - 57.89% -
435.gromacs 1.30% 230.000 233.000 - 45.62% -
435.gromacs (avg) 1.30% 230.000 233.000 - 45.62% -
483.xalancbmk 1.08% 93.000 94.000 - 113.64% -
483.xalancbmk (avg) 1.08% 93.000 94.000 - 113.64% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
470.lbm -4.15% 17853.000 17112.000 - 4.90% -
437.leslie3d -4.13% 18189.000 17437.000 - -3.50% -
481.wrf -3.75% 23173.000 22305.000 - 1.43% -
482.sphinx3 -3.22% 35010.000 33883.000 - -7.39% -
465.tonto -2.63% 13704.000 13343.000 - 2.29% -
464.h264ref -1.34% 14006.000 13818.000 - -9.14% -
459.GemsFDTD -1.16% 24135.000 23856.000 - -5.95% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) -98.09% 1202.000 23.000 - -60.34% -
464.h264ref (unexplained diff vs previous) (percentage) -98.02% 8.580 0.170 - -55.26% -
429.mcf (unexplained diff vs previous) (percentage) -97.99% 19.440 0.390 - 333.33% -
429.mcf (unexplained diff vs previous) -97.99% 2830.000 57.000 - 470.00% -
456.hmmer (unexplained diff vs previous) (percentage) -97.60% 1.250 0.030 - -94.23% -
456.hmmer (unexplained diff vs previous) -97.45% 235.000 6.000 - -93.88% -
450.soplex (unexplained diff vs previous) -97.37% 571.000 15.000 - -78.26% -
450.soplex (unexplained diff vs previous) (percentage) -97.35% 3.770 0.100 - -77.27% -
471.omnetpp (unexplained diff vs previous) (percentage) -96.87% 17.230 0.540 - -19.40% -
471.omnetpp (unexplained diff vs previous) -96.84% 1928.000 61.000 - -1.61% -
462.libquantum (unexplained diff vs previous) -96.61% 708.000 24.000 - 71.43% -
462.libquantum (unexplained diff vs previous) (percentage) -96.50% 4.000 0.140 - 75.00% -
458.sjeng (unexplained diff vs previous) -96.20% 842.000 32.000 - -33.33% -
458.sjeng (unexplained diff vs previous) (percentage) -96.19% 4.990 0.190 - -36.67% -
482.sphinx3 (unexplained diff vs previous) -94.80% 1576.000 82.000 - -92.67% -
482.sphinx3 (unexplained diff vs previous) (percentage) -94.67% 4.500 0.240 - -92.16% -
473.astar (unexplained diff vs previous) -91.33% 369.000 32.000 - -47.54% -
473.astar (unexplained diff vs previous) (percentage) -91.30% 2.760 0.240 - -48.94% -
403.gcc (unexplained diff vs previous) -83.08% 260.000 44.000 - -15.38% -
403.gcc (unexplained diff vs previous) (percentage) -83.06% 3.010 0.510 - -12.07% -
470.lbm (unexplained diff vs previous) -81.70% 1541.000 282.000 - -65.69% -
470.lbm (unexplained diff vs previous) (percentage) -80.88% 8.630 1.650 - -67.26% -
401.bzip2 (unexplained diff vs previous) (percentage) -73.61% 4.660 1.230 - 200.00% -
401.bzip2 (unexplained diff vs previous) -73.38% 755.000 201.000 - 191.30% -
459.GemsFDTD (unexplained diff vs previous) -50.77% 1229.000 605.000 - 3.60% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -50.10% 5.090 2.540 - 10.43% -
433.milc (unexplained diff vs previous) (percentage) -48.25% 3.150 1.630 - 132.86% -
433.milc (unexplained diff vs previous) -47.85% 418.000 218.000 - 127.08% -
444.namd (unexplained diff vs previous) (percentage) -43.01% 8.300 4.730 - -9.56% -
444.namd (unexplained diff vs previous) -43.01% 1223.000 697.000 - -16.43% -
470.lbm (max) -36.10% 1687.000 1078.000 - 20.72% -
482.sphinx3 (max) -35.54% 1508.000 972.000 - -15.62% -
453.povray (max) -33.78% 675.000 447.000 - 134.03% -
473.astar (max) (percentage) -33.45% 2.840 1.890 - 302.13% -
482.sphinx3 (max) (percentage) -33.41% 4.310 2.870 - -8.89% -
453.povray (max) (percentage) -33.37% 8.420 5.610 - 116.60% -
471.omnetpp (max) (percentage) -33.35% 20.810 13.870 - 645.70% -
433.milc (max) (percentage) -33.33% 3.060 2.040 - 187.32% -
470.lbm (max) (percentage) -33.33% 9.450 6.300 - 14.96% -
473.astar (max) -33.25% 379.000 253.000 - 314.75% -
403.gcc (max) (percentage) -33.22% 2.920 1.950 - 230.51% -
403.gcc (max) -33.07% 251.000 168.000 - 223.08% -
433.milc (max) -32.84% 405.000 272.000 - 180.41% -
471.omnetpp (max) -32.67% 2329.000 1568.000 - 811.63% -
434.zeusmp (unexplained diff vs previous) -30.21% 619.000 432.000 - -8.09% -
434.zeusmp (unexplained diff vs previous) (percentage) -29.97% 2.870 2.010 - -10.67% -
456.hmmer (max) -25.00% 232.000 174.000 - 77.55% -
456.hmmer (max) (percentage) -25.00% 1.240 0.930 - 78.85% -
429.mcf (max) (percentage) -24.99% 24.130 18.100 - 5556.25% -
429.mcf (max) -24.74% 3512.000 2643.000 - 7043.24% -
445.gobmk (max) (percentage) -16.67% 0.420 0.350 - 29.63% -
434.zeusmp (max) -16.64% 637.000 531.000 - 10.40% -
454.calculix (max) -16.64% 577.000 481.000 - 76.84% -
462.libquantum (max) (percentage) -16.59% 4.160 3.470 - 4237.50% -
454.calculix (max) (percentage) -16.57% 1.810 1.510 - 79.76% -
434.zeusmp (max) (percentage) -16.55% 2.960 2.470 - 7.39% -
400.perlbench (unexplained diff vs previous) (percentage) -16.48% 0.910 0.760 - 145.16% -
462.libquantum (max) -16.30% 736.000 616.000 - 4638.46% -
400.perlbench (max) -16.00% 100.000 84.000 - -5.62% -
400.perlbench (unexplained diff vs previous) -15.84% 101.000 85.000 - 142.86% -
481.wrf (max) -15.76% 1244.000 1048.000 - 14.66% -
445.gobmk (max) -15.69% 51.000 43.000 - 30.30% -
400.perlbench (max) (percentage) -15.56% 0.900 0.760 - -5.00% -
464.h264ref (max) -15.46% 1106.000 935.000 - 1484.75% -
450.soplex (max) (percentage) -14.33% 3.630 3.110 - 606.82% -
464.h264ref (max) (percentage) -14.30% 7.900 6.770 - 1635.90% -
450.soplex (max) -14.03% 549.000 472.000 - 584.06% -
459.GemsFDTD (max) -13.59% 1170.000 1011.000 - 74.91% -
456.hmmer (avg) (percentage) -13.51% 0.370 0.320 - 6.67% -
456.hmmer -13.04% 69.000 60.000 - 7.14% -
456.hmmer (avg) -13.04% 69.000 60.000 - 7.14% -
401.bzip2 (max) (percentage) -12.58% 4.450 3.890 - 872.50% -
459.GemsFDTD (max) (percentage) -12.58% 4.850 4.240 - 85.96% -
435.gromacs (max) (percentage) -12.55% 7.650 6.690 - 280.11% -
458.sjeng (max) (percentage) -12.55% 5.260 4.600 - 1433.33% -
444.namd (max) (percentage) -12.53% 7.660 6.700 - 21.60% -
483.xalancbmk (max) (percentage) -12.50% 6.880 6.020 - 554.35% -
444.namd (max) -12.50% 1128.000 987.000 - 12.29% -
481.wrf (max) (percentage) -12.48% 5.370 4.700 - 12.98% -
435.gromacs (max) -12.44% 1190.000 1042.000 - 252.03% -
458.sjeng (max) -12.42% 886.000 776.000 - 1516.67% -
483.xalancbmk (max) -12.03% 590.000 519.000 - 610.96% -
401.bzip2 (max) -11.93% 721.000 635.000 - 847.76% -
458.sjeng -11.54% 104.000 92.000 - 155.56% -
458.sjeng (avg) -11.54% 104.000 92.000 - 155.56% -
458.sjeng (avg) (percentage) -11.29% 0.620 0.550 - 139.13% -
429.mcf (avg) (percentage) -11.00% 2.090 1.860 - 287.50% -
429.mcf -10.86% 304.000 271.000 - 383.93% -
429.mcf (avg) -10.86% 304.000 271.000 - 383.93% -
465.tonto (max) -10.10% 693.000 623.000 - 179.37% -
482.sphinx3 -9.41% 871.000 789.000 - -8.15% -
482.sphinx3 (avg) -9.41% 871.000 789.000 - -8.15% -
462.libquantum (avg) (percentage) -8.51% 0.470 0.430 - 126.32% -
462.libquantum -8.43% 83.000 76.000 - 137.50% -
462.libquantum (avg) -8.43% 83.000 76.000 - 137.50% -
450.soplex -8.00% 75.000 69.000 - 86.49% -
450.soplex (avg) -8.00% 75.000 69.000 - 86.49% -
450.soplex (avg) (percentage) -8.00% 0.500 0.460 - 91.67% -
465.tonto (max) (percentage) -7.71% 5.060 4.670 - 173.10% -
471.omnetpp (avg) (percentage) -7.51% 2.530 2.340 - 98.31% -
471.omnetpp -6.71% 283.000 264.000 - 142.20% -
471.omnetpp (avg) -6.71% 283.000 264.000 - 142.20% -
482.sphinx3 (avg) (percentage) -6.43% 2.490 2.330 - -0.85% -
464.h264ref -5.22% 134.000 127.000 - 115.25% -
464.h264ref (avg) -5.22% 134.000 127.000 - 115.25% -
470.lbm -5.20% 731.000 693.000 - 13.98% -
470.lbm (avg) -5.20% 731.000 693.000 - 13.98% -
464.h264ref (avg) (percentage) -4.17% 0.960 0.920 - 135.90% -
481.wrf -3.70% 648.000 624.000 - 10.44% -
481.wrf (avg) -3.70% 648.000 624.000 - 10.44% -
465.tonto -2.49% 201.000 196.000 - 32.43% -
465.tonto (avg) -2.49% 201.000 196.000 - 32.43% -
403.gcc -1.89% 53.000 52.000 - 36.84% -
403.gcc (avg) -1.89% 53.000 52.000 - 36.84% -
473.astar (avg) (percentage) -1.79% 0.560 0.550 - 37.50% -
453.povray -1.79% 168.000 165.000 - 46.02% -
453.povray (avg) -1.79% 168.000 165.000 - 46.02% -
403.gcc (avg) (percentage) -1.61% 0.620 0.610 - 41.86% -
453.povray (avg) (percentage) -1.43% 2.100 2.070 - 35.29% -
473.astar -1.35% 74.000 73.000 - 43.14% -
473.astar (avg) -1.35% 74.000 73.000 - 43.14% -
470.lbm (avg) (percentage) -1.22% 4.100 4.050 - 8.58% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 24.55% 11727.000 14606.000 - 0.34% -
471.omnetpp 22.07% 9265.000 11310.000 - 1.05% -
453.povray 7.91% 7395.000 7980.000 - -0.47% -
483.xalancbmk 7.47% 8027.000 8627.000 - 0.56% -
458.sjeng 5.38% 16018.000 16879.000 - 0.11% -
470.lbm 4.90% 16312.000 17112.000 - -4.15% -
462.libquantum 4.44% 17005.000 17760.000 - 0.27% -
473.astar 3.41% 12983.000 13426.000 - 0.55% -
434.zeusmp 2.79% 20932.000 21517.000 - -0.16% -
410.bwaves 2.46% 14745.000 15107.000 - 4.64% -
436.cactusADM 2.30% 24396.000 24957.000 - 0.08% -
465.tonto 2.29% 13044.000 13343.000 - -2.63% -
481.wrf 1.43% 21991.000 22305.000 - -3.75% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) 7043.24% 37.000 2643.000 - -24.74% -
429.mcf (max) (percentage) 5556.25% 0.320 18.100 - -24.99% -
462.libquantum (max) 4638.46% 13.000 616.000 - -16.30% -
462.libquantum (max) (percentage) 4237.50% 0.080 3.470 - -16.59% -
464.h264ref (max) (percentage) 1635.90% 0.390 6.770 - -14.30% -
458.sjeng (max) 1516.67% 48.000 776.000 - -12.42% -
464.h264ref (max) 1484.75% 59.000 935.000 - -15.46% -
458.sjeng (max) (percentage) 1433.33% 0.300 4.600 - -12.55% -
401.bzip2 (max) (percentage) 872.50% 0.400 3.890 - -12.58% -
401.bzip2 (max) 847.76% 67.000 635.000 - -11.93% -
471.omnetpp (max) 811.63% 172.000 1568.000 - -32.67% -
471.omnetpp (max) (percentage) 645.70% 1.860 13.870 - -33.35% -
483.xalancbmk (max) 610.96% 73.000 519.000 - -12.03% -
450.soplex (max) (percentage) 606.82% 0.440 3.110 - -14.33% -
450.soplex (max) 584.06% 69.000 472.000 - -14.03% -
483.xalancbmk (max) (percentage) 554.35% 0.920 6.020 - -12.50% -
429.mcf (unexplained diff vs previous) 470.00% 10.000 57.000 - -97.99% -
429.mcf 383.93% 56.000 271.000 - -10.86% -
429.mcf (avg) 383.93% 56.000 271.000 - -10.86% -
429.mcf (unexplained diff vs previous) (percentage) 333.33% 0.090 0.390 - -97.99% -
437.leslie3d (unexplained diff vs previous) (percentage) 333.01% 1.030 4.460 - 586.15% -
437.leslie3d (unexplained diff vs previous) 316.04% 187.000 778.000 - 553.78% -
473.astar (max) 314.75% 61.000 253.000 - -33.25% -
473.astar (max) (percentage) 302.13% 0.470 1.890 - -33.45% -
429.mcf (avg) (percentage) 287.50% 0.480 1.860 - -11.00% -
410.bwaves (max) 282.31% 260.000 994.000 - 230.23% -
435.gromacs (max) (percentage) 280.11% 1.760 6.690 - -12.55% -
447.dealII (unexplained diff vs previous) 277.94% 68.000 257.000 - 335.59% -
447.dealII (unexplained diff vs previous) (percentage) 277.33% 0.750 2.830 - 335.38% -
410.bwaves (max) (percentage) 271.75% 1.770 6.580 - 214.83% -
410.bwaves (unexplained diff vs previous) 263.04% 257.000 933.000 - 202.92% -
410.bwaves (unexplained diff vs previous) (percentage) 255.17% 1.740 6.180 - 190.14% -
435.gromacs (max) 252.03% 296.000 1042.000 - -12.44% -
403.gcc (max) (percentage) 230.51% 0.590 1.950 - -33.22% -
403.gcc (max) 223.08% 52.000 168.000 - -33.07% -
401.bzip2 (unexplained diff vs previous) (percentage) 200.00% 0.410 1.230 - -73.61% -
401.bzip2 (unexplained diff vs previous) 191.30% 69.000 201.000 - -73.38% -
433.milc (max) (percentage) 187.32% 0.710 2.040 - -33.33% -
433.milc (max) 180.41% 97.000 272.000 - -32.84% -
465.tonto (max) 179.37% 223.000 623.000 - -10.10% -
465.tonto (max) (percentage) 173.10% 1.710 4.670 - -7.71% -
458.sjeng 155.56% 36.000 92.000 - -11.54% -
458.sjeng (avg) 155.56% 36.000 92.000 - -11.54% -
400.perlbench (unexplained diff vs previous) (percentage) 145.16% 0.310 0.760 - -16.48% -
400.perlbench (unexplained diff vs previous) 142.86% 35.000 85.000 - -15.84% -
471.omnetpp 142.20% 109.000 264.000 - -6.71% -
471.omnetpp (avg) 142.20% 109.000 264.000 - -6.71% -
458.sjeng (avg) (percentage) 139.13% 0.230 0.550 - -11.29% -
462.libquantum 137.50% 32.000 76.000 - -8.43% -
462.libquantum (avg) 137.50% 32.000 76.000 - -8.43% -
464.h264ref (avg) (percentage) 135.90% 0.390 0.920 - -4.17% -
453.povray (max) 134.03% 191.000 447.000 - -33.78% -
401.bzip2 (avg) (percentage) 133.33% 0.270 0.630 - 8.62% -
433.milc (unexplained diff vs previous) (percentage) 132.86% 0.700 1.630 - -48.25% -
433.milc (unexplained diff vs previous) 127.08% 96.000 218.000 - -47.85% -
401.bzip2 126.67% 45.000 102.000 - 8.51% -
401.bzip2 (avg) 126.67% 45.000 102.000 - 8.51% -
462.libquantum (avg) (percentage) 126.32% 0.190 0.430 - -8.51% -
453.povray (max) (percentage) 116.60% 2.590 5.610 - -33.37% -
464.h264ref 115.25% 59.000 127.000 - -5.22% -
464.h264ref (avg) 115.25% 59.000 127.000 - -5.22% -
483.xalancbmk 113.64% 44.000 94.000 - 1.08% -
483.xalancbmk (avg) 113.64% 44.000 94.000 - 1.08% -
471.omnetpp (avg) (percentage) 98.31% 1.180 2.340 - -7.51% -
483.xalancbmk (avg) (percentage) 94.64% 0.560 1.090 - 0.00% -
450.soplex (avg) (percentage) 91.67% 0.240 0.460 - -8.00% -
450.soplex 86.49% 37.000 69.000 - -8.00% -
450.soplex (avg) 86.49% 37.000 69.000 - -8.00% -
459.GemsFDTD (max) (percentage) 85.96% 2.280 4.240 - -12.58% -
454.calculix (max) (percentage) 79.76% 0.840 1.510 - -16.57% -
456.hmmer (max) (percentage) 78.85% 0.520 0.930 - -25.00% -
456.hmmer (max) 77.55% 98.000 174.000 - -25.00% -
454.calculix (max) 76.84% 272.000 481.000 - -16.64% -
462.libquantum (unexplained diff vs previous) (percentage) 75.00% 0.080 0.140 - -96.50% -
459.GemsFDTD (max) 74.91% 578.000 1011.000 - -13.59% -
462.libquantum (unexplained diff vs previous) 71.43% 14.000 24.000 - -96.61% -
447.dealII (max) (percentage) 69.09% 1.650 2.790 - 83.55% -
447.dealII (max) 68.67% 150.000 253.000 - 84.67% -
435.gromacs (avg) (percentage) 57.89% 0.950 1.500 - 1.35% -
453.povray 46.02% 113.000 165.000 - -1.79% -
453.povray (avg) 46.02% 113.000 165.000 - -1.79% -
435.gromacs 45.62% 160.000 233.000 - 1.30% -
435.gromacs (avg) 45.62% 160.000 233.000 - 1.30% -
473.astar 43.14% 51.000 73.000 - -1.35% -
473.astar (avg) 43.14% 51.000 73.000 - -1.35% -
403.gcc (avg) (percentage) 41.86% 0.430 0.610 - -1.61% -
437.leslie3d (max) (percentage) 37.74% 3.100 4.270 - 46.74% -
473.astar (avg) (percentage) 37.50% 0.400 0.550 - -1.79% -
403.gcc 36.84% 38.000 52.000 - -1.89% -
403.gcc (avg) 36.84% 38.000 52.000 - -1.89% -
447.dealII (avg) (percentage) 35.63% 0.870 1.180 - 37.21% -
447.dealII 35.44% 79.000 107.000 - 38.96% -
447.dealII (avg) 35.44% 79.000 107.000 - 38.96% -
453.povray (avg) (percentage) 35.29% 1.530 2.070 - -1.43% -
437.leslie3d (max) 32.86% 560.000 744.000 - 40.64% -
465.tonto 32.43% 148.000 196.000 - -2.49% -
465.tonto (avg) 32.43% 148.000 196.000 - -2.49% -
433.milc (avg) (percentage) 30.43% 0.690 0.900 - 4.65% -
445.gobmk (max) 30.30% 33.000 43.000 - -15.69% -
445.gobmk (max) (percentage) 29.63% 0.270 0.350 - -16.67% -
465.tonto (avg) (percentage) 28.95% 1.140 1.470 - 0.00% -
433.milc 27.66% 94.000 120.000 - 6.19% -
433.milc (avg) 27.66% 94.000 120.000 - 6.19% -
459.GemsFDTD (avg) (percentage) 23.02% 1.390 1.710 - 1.79% -
444.namd (avg) (percentage) 22.69% 2.600 3.190 - 7.41% -
434.zeusmp 21.96% 255.000 311.000 - 7.24% -
434.zeusmp (avg) 21.96% 255.000 311.000 - 7.24% -
444.namd (max) (percentage) 21.60% 5.510 6.700 - -12.53% -
470.lbm (max) 20.72% 893.000 1078.000 - -36.10% -
434.zeusmp (avg) (percentage) 18.85% 1.220 1.450 - 7.41% -
410.bwaves 17.99% 289.000 341.000 - 20.07% -
410.bwaves (avg) 17.99% 289.000 341.000 - 20.07% -
400.perlbench 16.28% 43.000 50.000 - 6.38% -
400.perlbench (avg) 16.28% 43.000 50.000 - 6.38% -
459.GemsFDTD 15.62% 352.000 407.000 - 0.49% -
459.GemsFDTD (avg) 15.62% 352.000 407.000 - 0.49% -
400.perlbench (avg) (percentage) 15.38% 0.390 0.450 - 4.65% -
410.bwaves (avg) (percentage) 15.31% 1.960 2.260 - 14.72% -
470.lbm (max) (percentage) 14.96% 5.480 6.300 - -33.33% -
481.wrf (max) 14.66% 914.000 1048.000 - -15.76% -
470.lbm 13.98% 608.000 693.000 - -5.20% -
470.lbm (avg) 13.98% 608.000 693.000 - -5.20% -
416.gamess (avg) (percentage) 13.94% 1.650 1.880 - 10.59% -
436.cactusADM 13.85% 585.000 666.000 - 11.93% -
436.cactusADM (avg) 13.85% 585.000 666.000 - 11.93% -
444.namd 13.53% 414.000 470.000 - 7.55% -
444.namd (avg) 13.53% 414.000 470.000 - 7.55% -
481.wrf (max) (percentage) 12.98% 4.160 4.700 - -12.48% -
444.namd (max) 12.29% 879.000 987.000 - -12.50% -
436.cactusADM (avg) (percentage) 11.25% 2.400 2.670 - 11.72% -
416.gamess 10.93% 485.000 538.000 - 10.25% -
416.gamess (avg) 10.93% 485.000 538.000 - 10.25% -
481.wrf 10.44% 565.000 624.000 - -3.70% -
481.wrf (avg) 10.44% 565.000 624.000 - -3.70% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 10.43% 2.300 2.540 - -50.10% -
434.zeusmp (max) 10.40% 481.000 531.000 - -16.64% -
445.gobmk (avg) (percentage) 9.09% 0.220 0.240 - 0.00% -
481.wrf (avg) (percentage) 8.95% 2.570 2.800 - 0.00% -
470.lbm (avg) (percentage) 8.58% 3.730 4.050 - -1.22% -
445.gobmk 7.41% 27.000 29.000 - 0.00% -
445.gobmk (avg) 7.41% 27.000 29.000 - 0.00% -
434.zeusmp (max) (percentage) 7.39% 2.300 2.470 - -16.55% -
456.hmmer 7.14% 56.000 60.000 - -13.04% -
456.hmmer (avg) 7.14% 56.000 60.000 - -13.04% -
456.hmmer (avg) (percentage) 6.67% 0.300 0.320 - -13.51% -
459.GemsFDTD (unexplained diff vs previous) 3.60% 584.000 605.000 - -50.77% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -9.14% 15208.000 13818.000 - -1.34% -
444.namd -7.64% 15957.000 14738.000 - 0.03% -
435.gromacs -7.57% 16853.000 15577.000 - 0.09% -
482.sphinx3 -7.39% 36586.000 33883.000 - -3.22% -
459.GemsFDTD -5.95% 25364.000 23856.000 - -1.16% -
401.bzip2 -3.78% 16971.000 16329.000 - 0.70% -
437.leslie3d -3.50% 18070.000 17437.000 - -4.13% -
450.soplex -3.35% 15709.000 15182.000 - 0.29% -
403.gcc -3.03% 8890.000 8621.000 - -0.10% -
416.gamess -2.66% 29409.000 28628.000 - -0.29% -
433.milc -2.14% 13668.000 13375.000 - 0.94% -
454.calculix -1.88% 32491.000 31881.000 - -0.07% -
456.hmmer -1.20% 18995.000 18768.000 - 0.04% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
456.hmmer (unexplained diff vs previous) (percentage) -94.23% 0.520 0.030 - -97.60% -
456.hmmer (unexplained diff vs previous) -93.88% 98.000 6.000 - -97.45% -
482.sphinx3 (unexplained diff vs previous) -92.67% 1118.000 82.000 - -94.80% -
482.sphinx3 (unexplained diff vs previous) (percentage) -92.16% 3.060 0.240 - -94.67% -
450.soplex (unexplained diff vs previous) -78.26% 69.000 15.000 - -97.37% -
450.soplex (unexplained diff vs previous) (percentage) -77.27% 0.440 0.100 - -97.35% -
470.lbm (unexplained diff vs previous) (percentage) -67.26% 5.040 1.650 - -80.88% -
470.lbm (unexplained diff vs previous) -65.69% 822.000 282.000 - -81.70% -
464.h264ref (unexplained diff vs previous) -60.34% 58.000 23.000 - -98.09% -
464.h264ref (unexplained diff vs previous) (percentage) -55.26% 0.380 0.170 - -98.02% -
473.astar (unexplained diff vs previous) (percentage) -48.94% 0.470 0.240 - -91.30% -
473.astar (unexplained diff vs previous) -47.54% 61.000 32.000 - -91.33% -
458.sjeng (unexplained diff vs previous) (percentage) -36.67% 0.300 0.190 - -96.19% -
458.sjeng (unexplained diff vs previous) -33.33% 48.000 32.000 - -96.20% -
471.omnetpp (unexplained diff vs previous) (percentage) -19.40% 0.670 0.540 - -96.87% -
444.namd (unexplained diff vs previous) -16.43% 834.000 697.000 - -43.01% -
482.sphinx3 (max) -15.62% 1152.000 972.000 - -35.54% -
403.gcc (unexplained diff vs previous) -15.38% 52.000 44.000 - -83.08% -
403.gcc (unexplained diff vs previous) (percentage) -12.07% 0.580 0.510 - -83.06% -
434.zeusmp (unexplained diff vs previous) (percentage) -10.67% 2.250 2.010 - -29.97% -
444.namd (unexplained diff vs previous) (percentage) -9.56% 5.230 4.730 - -43.01% -
482.sphinx3 (max) (percentage) -8.89% 3.150 2.870 - -33.41% -
416.gamess (max) -8.56% 923.000 844.000 - 2.18% -
416.gamess (unexplained diff vs previous) -8.48% 896.000 820.000 - 17.31% -
482.sphinx3 -8.15% 859.000 789.000 - -9.41% -
482.sphinx3 (avg) -8.15% 859.000 789.000 - -9.41% -
434.zeusmp (unexplained diff vs previous) -8.09% 470.000 432.000 - -30.21% -
416.gamess (unexplained diff vs previous) (percentage) -6.23% 3.050 2.860 - 17.70% -
416.gamess (max) (percentage) -6.05% 3.140 2.950 - 2.43% -
400.perlbench (max) -5.62% 89.000 84.000 - -16.00% -
400.perlbench (max) (percentage) -5.00% 0.800 0.760 - -15.56% -
437.leslie3d -2.99% 301.000 292.000 - 0.34% -
437.leslie3d (avg) -2.99% 301.000 292.000 - 0.34% -
454.calculix -2.43% 659.000 643.000 - -0.16% -
454.calculix (avg) -2.43% 659.000 643.000 - -0.16% -
436.cactusADM (unexplained diff vs previous) (percentage) -1.87% 4.810 4.720 - 117.51% -
436.cactusADM (max) (percentage) -1.78% 5.050 4.960 - 17.81% -
471.omnetpp (unexplained diff vs previous) -1.61% 62.000 61.000 - -96.84% -

Report Time: 0.36s
Execution (seconds)
Name Current %
400.perlbench 11161.000 -
401.bzip2 16329.000 -
403.gcc 8621.000 -
410.bwaves 15107.000 4.64%
416.gamess 28628.000 -
429.mcf 14606.000 -
433.milc 13375.000 -
434.zeusmp 21517.000 -
435.gromacs 15577.000 -
436.cactusADM 24957.000 -
437.leslie3d 17437.000 -4.13%
444.namd 14738.000 -
445.gobmk 12405.000 -
447.dealII 9088.000 -
450.soplex 15182.000 -
453.povray 7980.000 -
454.calculix 31881.000 -
456.hmmer 18768.000 -
458.sjeng 16879.000 -
459.GemsFDTD 23856.000 -1.16%
462.libquantum 17760.000 -
464.h264ref 13818.000 -1.34%
465.tonto 13343.000 -2.63%
470.lbm 17112.000 -4.15%
471.omnetpp 11310.000 1.05%
473.astar 13426.000 -
481.wrf 22305.000 -3.75%
482.sphinx3 33883.000 -3.22%
483.xalancbmk 8627.000 -
Geometric Mean 15744.540 -
Code Size (bytes)
Name Current %
400.perlbench 563463.000 -
401.bzip2 33660.000 -
403.gcc 1589863.000 -
410.bwaves 14722.000 -
416.gamess 4554720.000 -
429.mcf 7717.000 -
433.milc 47497.000 -
434.zeusmp 141060.000 -
435.gromacs 393994.000 -
436.cactusADM 256976.000 -
437.leslie3d 48001.000 -
444.namd 162769.000 -
445.gobmk 1088208.000 -
447.dealII 191136.000 -
450.soplex 135596.000 -
453.povray 488989.000 -
454.calculix 682316.000 -
456.hmmer 74977.000 -
458.sjeng 81189.000 -
459.GemsFDTD 195774.000 -
462.libquantum 13066.000 -
464.h264ref 301362.000 -
465.tonto 1436141.000 -
470.lbm 10845.000 -
471.omnetpp 295652.000 -
473.astar 15549.000 -
481.wrf 1539765.000 -
482.sphinx3 80058.000 -
483.xalancbmk 1462882.000 -
Geometric Mean 169871.110 -
sample variability
Name Current %
400.perlbench 50.000 6.38%
400.perlbench (avg) 50.000 6.38%
400.perlbench (avg) (percentage) 0.450 4.65%
400.perlbench (max) 84.000 -16.00%
400.perlbench (max) (percentage) 0.760 -15.56%
400.perlbench (unexplained diff vs previous) 85.000 -15.84%
400.perlbench (unexplained diff vs previous) (percentage) 0.760 -16.48%
401.bzip2 102.000 8.51%
401.bzip2 (avg) 102.000 8.51%
401.bzip2 (avg) (percentage) 0.630 8.62%
401.bzip2 (max) 635.000 -11.93%
401.bzip2 (max) (percentage) 3.890 -12.58%
401.bzip2 (unexplained diff vs previous) 201.000 -73.38%
401.bzip2 (unexplained diff vs previous) (percentage) 1.230 -73.61%
403.gcc 52.000 -1.89%
403.gcc (avg) 52.000 -1.89%
403.gcc (avg) (percentage) 0.610 -1.61%
403.gcc (max) 168.000 -33.07%
403.gcc (max) (percentage) 1.950 -33.22%
403.gcc (unexplained diff vs previous) 44.000 -83.08%
403.gcc (unexplained diff vs previous) (percentage) 0.510 -83.06%
410.bwaves 341.000 20.07%
410.bwaves (avg) 341.000 20.07%
410.bwaves (avg) (percentage) 2.260 14.72%
410.bwaves (max) 994.000 230.23%
410.bwaves (max) (percentage) 6.580 214.83%
410.bwaves (unexplained diff vs previous) 933.000 202.92%
410.bwaves (unexplained diff vs previous) (percentage) 6.180 190.14%
416.gamess 538.000 10.25%
416.gamess (avg) 538.000 10.25%
416.gamess (avg) (percentage) 1.880 10.59%
416.gamess (max) 844.000 2.18%
416.gamess (max) (percentage) 2.950 2.43%
416.gamess (unexplained diff vs previous) 820.000 17.31%
416.gamess (unexplained diff vs previous) (percentage) 2.860 17.70%
429.mcf 271.000 -10.86%
429.mcf (avg) 271.000 -10.86%
429.mcf (avg) (percentage) 1.860 -11.00%
429.mcf (max) 2643.000 -24.74%
429.mcf (max) (percentage) 18.100 -24.99%
429.mcf (unexplained diff vs previous) 57.000 -97.99%
429.mcf (unexplained diff vs previous) (percentage) 0.390 -97.99%
433.milc 120.000 6.19%
433.milc (avg) 120.000 6.19%
433.milc (avg) (percentage) 0.900 4.65%
433.milc (max) 272.000 -32.84%
433.milc (max) (percentage) 2.040 -33.33%
433.milc (unexplained diff vs previous) 218.000 -47.85%
433.milc (unexplained diff vs previous) (percentage) 1.630 -48.25%
434.zeusmp 311.000 7.24%
434.zeusmp (avg) 311.000 7.24%
434.zeusmp (avg) (percentage) 1.450 7.41%
434.zeusmp (max) 531.000 -16.64%
434.zeusmp (max) (percentage) 2.470 -16.55%
434.zeusmp (unexplained diff vs previous) 432.000 -30.21%
434.zeusmp (unexplained diff vs previous) (percentage) 2.010 -29.97%
435.gromacs 233.000 1.30%
435.gromacs (avg) 233.000 1.30%
435.gromacs (avg) (percentage) 1.500 1.35%
435.gromacs (max) 1042.000 -12.44%
435.gromacs (max) (percentage) 6.690 -12.55%
436.cactusADM 666.000 11.93%
436.cactusADM (avg) 666.000 11.93%
436.cactusADM (avg) (percentage) 2.670 11.72%
436.cactusADM (max) 1237.000 17.92%
436.cactusADM (max) (percentage) 4.960 17.81%
436.cactusADM (unexplained diff vs previous) 1179.000 118.33%
436.cactusADM (unexplained diff vs previous) (percentage) 4.720 117.51%
437.leslie3d 292.000 -
437.leslie3d (avg) 292.000 -
437.leslie3d (avg) (percentage) 1.680 5.00%
437.leslie3d (max) 744.000 40.64%
437.leslie3d (max) (percentage) 4.270 46.74%
437.leslie3d (unexplained diff vs previous) 778.000 553.78%
437.leslie3d (unexplained diff vs previous) (percentage) 4.460 586.15%
444.namd 470.000 7.55%
444.namd (avg) 470.000 7.55%
444.namd (avg) (percentage) 3.190 7.41%
444.namd (max) 987.000 -12.50%
444.namd (max) (percentage) 6.700 -12.53%
444.namd (unexplained diff vs previous) 697.000 -43.01%
444.namd (unexplained diff vs previous) (percentage) 4.730 -43.01%
445.gobmk 29.000 -
445.gobmk (avg) 29.000 -
445.gobmk (avg) (percentage) 0.240 -
445.gobmk (max) 43.000 -15.69%
445.gobmk (max) (percentage) 0.350 -16.67%
447.dealII 107.000 38.96%
447.dealII (avg) 107.000 38.96%
447.dealII (avg) (percentage) 1.180 37.21%
447.dealII (max) 253.000 84.67%
447.dealII (max) (percentage) 2.790 83.55%
447.dealII (unexplained diff vs previous) 257.000 335.59%
447.dealII (unexplained diff vs previous) (percentage) 2.830 335.38%
450.soplex 69.000 -8.00%
450.soplex (avg) 69.000 -8.00%
450.soplex (avg) (percentage) 0.460 -8.00%
450.soplex (max) 472.000 -14.03%
450.soplex (max) (percentage) 3.110 -14.33%
450.soplex (unexplained diff vs previous) 15.000 -97.37%
450.soplex (unexplained diff vs previous) (percentage) 0.100 -97.35%
453.povray 165.000 -1.79%
453.povray (avg) 165.000 -1.79%
453.povray (avg) (percentage) 2.070 -1.43%
453.povray (max) 447.000 -33.78%
453.povray (max) (percentage) 5.610 -33.37%
454.calculix 643.000 -
454.calculix (avg) 643.000 -
454.calculix (avg) (percentage) 2.020 -
454.calculix (max) 481.000 -16.64%
454.calculix (max) (percentage) 1.510 -16.57%
456.hmmer 60.000 -13.04%
456.hmmer (avg) 60.000 -13.04%
456.hmmer (avg) (percentage) 0.320 -13.51%
456.hmmer (max) 174.000 -25.00%
456.hmmer (max) (percentage) 0.930 -25.00%
456.hmmer (unexplained diff vs previous) 6.000 -97.45%
456.hmmer (unexplained diff vs previous) (percentage) 0.030 -97.60%
458.sjeng 92.000 -11.54%
458.sjeng (avg) 92.000 -11.54%
458.sjeng (avg) (percentage) 0.550 -11.29%
458.sjeng (max) 776.000 -12.42%
458.sjeng (max) (percentage) 4.600 -12.55%
458.sjeng (unexplained diff vs previous) 32.000 -96.20%
458.sjeng (unexplained diff vs previous) (percentage) 0.190 -96.19%
459.GemsFDTD 407.000 -
459.GemsFDTD (avg) 407.000 -
459.GemsFDTD (avg) (percentage) 1.710 1.79%
459.GemsFDTD (max) 1011.000 -13.59%
459.GemsFDTD (max) (percentage) 4.240 -12.58%
459.GemsFDTD (unexplained diff vs previous) 605.000 -50.77%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.540 -50.10%
462.libquantum 76.000 -8.43%
462.libquantum (avg) 76.000 -8.43%
462.libquantum (avg) (percentage) 0.430 -8.51%
462.libquantum (max) 616.000 -16.30%
462.libquantum (max) (percentage) 3.470 -16.59%
462.libquantum (unexplained diff vs previous) 24.000 -96.61%
462.libquantum (unexplained diff vs previous) (percentage) 0.140 -96.50%
464.h264ref 127.000 -5.22%
464.h264ref (avg) 127.000 -5.22%
464.h264ref (avg) (percentage) 0.920 -4.17%
464.h264ref (max) 935.000 -15.46%
464.h264ref (max) (percentage) 6.770 -14.30%
464.h264ref (unexplained diff vs previous) 23.000 -98.09%
464.h264ref (unexplained diff vs previous) (percentage) 0.170 -98.02%
465.tonto 196.000 -2.49%
465.tonto (avg) 196.000 -2.49%
465.tonto (avg) (percentage) 1.470 -
465.tonto (max) 623.000 -10.10%
465.tonto (max) (percentage) 4.670 -7.71%
470.lbm 693.000 -5.20%
470.lbm (avg) 693.000 -5.20%
470.lbm (avg) (percentage) 4.050 -1.22%
470.lbm (max) 1078.000 -36.10%
470.lbm (max) (percentage) 6.300 -33.33%
470.lbm (unexplained diff vs previous) 282.000 -81.70%
470.lbm (unexplained diff vs previous) (percentage) 1.650 -80.88%
471.omnetpp 264.000 -6.71%
471.omnetpp (avg) 264.000 -6.71%
471.omnetpp (avg) (percentage) 2.340 -7.51%
471.omnetpp (max) 1568.000 -32.67%
471.omnetpp (max) (percentage) 13.870 -33.35%
471.omnetpp (unexplained diff vs previous) 61.000 -96.84%
471.omnetpp (unexplained diff vs previous) (percentage) 0.540 -96.87%
473.astar 73.000 -1.35%
473.astar (avg) 73.000 -1.35%
473.astar (avg) (percentage) 0.550 -1.79%
473.astar (max) 253.000 -33.25%
473.astar (max) (percentage) 1.890 -33.45%
473.astar (unexplained diff vs previous) 32.000 -91.33%
473.astar (unexplained diff vs previous) (percentage) 0.240 -91.30%
481.wrf 624.000 -3.70%
481.wrf (avg) 624.000 -3.70%
481.wrf (avg) (percentage) 2.800 -
481.wrf (max) 1048.000 -15.76%
481.wrf (max) (percentage) 4.700 -12.48%
482.sphinx3 789.000 -9.41%
482.sphinx3 (avg) 789.000 -9.41%
482.sphinx3 (avg) (percentage) 2.330 -6.43%
482.sphinx3 (max) 972.000 -35.54%
482.sphinx3 (max) (percentage) 2.870 -33.41%
482.sphinx3 (unexplained diff vs previous) 82.000 -94.80%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.240 -94.67%
483.xalancbmk 94.000 1.08%
483.xalancbmk (avg) 94.000 1.08%
483.xalancbmk (avg) (percentage) 1.090 -
483.xalancbmk (max) 519.000 -12.03%
483.xalancbmk (max) (percentage) 6.020 -12.50%
Geometric Mean 27.875 -31.36%