Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=93c6e8c3c14bf81020ca7571fe752250a34f5bc9 (+ 46 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/5582ad0afb051a76231b2959487f4ef1746df283 (+ 120 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=5473a1747a7bd10a7a271c7e01e942711a707bb8 (+ 54 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=5212c40d4ee548e36f78eb62a3cf59ce347ab712 (+ 188 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/30/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0030 (4-changed-components) 2023-04-08T02:08:05 0:00:00
Previous 0022 (-00000-) 2023-04-03T23:32:24 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 25 85
Performance Improvements 147 137
Added Tests 2 0
Unchanged Tests 1062 1014
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 2.28% 922.000 943.000 - -97.42% -
400.perlbench 1.21% 1574.000 1593.000 - -85.80% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) 3400.00% 0.010 0.350 - 16.67% -
458.sjeng (unexplained diff vs previous) 2600.00% 1.000 27.000 - -43.75% -
453.povray (unexplained diff vs previous) 400.00% 1.000 5.000 - -97.04% -
453.povray (unexplained diff vs previous) (percentage) 400.00% 0.180 0.900 - -60.70% -
482.sphinx3 (unexplained diff vs previous) 90.91% 11.000 21.000 - -98.12% -
482.sphinx3 (unexplained diff vs previous) (percentage) 87.39% 1.190 2.230 - -27.12% -
429.mcf (unexplained diff vs previous) (percentage) 84.37% 0.640 1.180 - 1211.11% -
429.mcf (unexplained diff vs previous) 83.33% 6.000 11.000 - 10.00% -
459.GemsFDTD (unexplained diff vs previous) 75.00% 8.000 14.000 - -97.60% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 72.73% 0.110 0.190 - -91.74% -
435.gromacs (unexplained diff vs previous) (percentage) 44.12% 0.340 0.490 - -71.68% -
470.lbm (max) 42.86% 14.000 20.000 - -97.76% -
435.gromacs (unexplained diff vs previous) 42.31% 26.000 37.000 - -87.33% -
470.lbm (max) (percentage) 35.00% 0.400 0.540 - -90.15% -
470.lbm (unexplained diff vs previous) 33.33% 15.000 20.000 - -97.57% -
470.lbm (unexplained diff vs previous) (percentage) 32.50% 0.400 0.530 - -89.48% -
482.sphinx3 (max) 16.67% 18.000 21.000 - -98.18% -
473.astar (unexplained diff vs previous) 15.38% 39.000 45.000 - -26.23% -
473.astar (unexplained diff vs previous) (percentage) 15.00% 0.800 0.920 - 95.74% -
482.sphinx3 (max) (percentage) 14.00% 2.000 2.280 - -27.62% -
482.sphinx3 2.33% 43.000 44.000 - -94.88% -
482.sphinx3 (avg) 2.33% 43.000 44.000 - -94.88% -
473.astar (max) 1.72% 58.000 59.000 - -3.28% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -2.12% 613.000 600.000 - -96.18% -
403.gcc -1.72% 58.000 57.000 - -99.36% -
437.leslie3d -1.23% 11597.000 11454.000 - -36.61% -
429.mcf -1.17% 942.000 931.000 - -92.06% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -97.52% 1.210 0.030 - -92.68% -
401.bzip2 (unexplained diff vs previous) -97.22% 36.000 1.000 - -98.55% -
410.bwaves (max) -82.86% 210.000 36.000 - -86.15% -
410.bwaves (max) (percentage) -82.44% 3.530 0.620 - -64.97% -
456.hmmer (unexplained diff vs previous) (percentage) -81.82% 0.110 0.020 - -96.15% -
437.leslie3d (unexplained diff vs previous) -81.03% 754.000 143.000 - -23.53% -
437.leslie3d (unexplained diff vs previous) (percentage) -80.77% 6.500 1.250 - 21.36% -
433.milc (unexplained diff vs previous) -80.00% 5.000 1.000 - -98.96% -
456.hmmer (unexplained diff vs previous) -80.00% 5.000 1.000 - -98.98% -
433.milc (unexplained diff vs previous) (percentage) -79.55% 0.440 0.090 - -87.14% -
433.milc (max) -78.57% 14.000 3.000 - -96.91% -
471.omnetpp (unexplained diff vs previous) (percentage) -77.78% 0.450 0.100 - -85.07% -
471.omnetpp (unexplained diff vs previous) -76.92% 13.000 3.000 - -95.16% -
433.milc (max) (percentage) -75.00% 1.320 0.330 - -53.52% -
444.namd (max) -75.00% 4.000 1.000 - -99.89% -
436.cactusADM (unexplained diff vs previous) (percentage) -70.00% 0.500 0.150 - -96.88% -
436.cactusADM (unexplained diff vs previous) -69.23% 13.000 4.000 - -99.66% -
447.dealII (unexplained diff vs previous) -65.22% 23.000 8.000 - -88.24% -
447.dealII (unexplained diff vs previous) (percentage) -64.71% 1.190 0.420 - -44.00% -
434.zeusmp (max) -64.29% 56.000 20.000 - -95.84% -
434.zeusmp (max) (percentage) -63.29% 2.070 0.760 - -66.96% -
416.gamess (unexplained diff vs previous) -61.76% 34.000 13.000 - -98.55% -
450.soplex (unexplained diff vs previous) -61.76% 34.000 13.000 - -81.16% -
444.namd (max) (percentage) -61.54% 0.520 0.200 - -96.37% -
450.soplex (unexplained diff vs previous) (percentage) -60.90% 5.550 2.170 - 393.18% -
416.gamess (unexplained diff vs previous) (percentage) -60.87% 0.230 0.090 - -97.05% -
462.libquantum (unexplained diff vs previous) (percentage) -50.40% 1.250 0.620 - 675.00% -
444.namd (unexplained diff vs previous) -50.00% 2.000 1.000 - -99.88% -
444.namd (unexplained diff vs previous) (percentage) -50.00% 0.220 0.110 - -97.90% -
462.libquantum (max) -50.00% 2.000 1.000 - -92.31% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - -92.86% -
434.zeusmp (unexplained diff vs previous) -41.18% 17.000 10.000 - -97.87% -
450.soplex (max) -40.38% 52.000 31.000 - -55.07% -
434.zeusmp (unexplained diff vs previous) (percentage) -40.32% 0.620 0.370 - -83.56% -
450.soplex (max) (percentage) -38.17% 8.540 5.280 - 1100.00% -
464.h264ref (unexplained diff vs previous) (percentage) -37.21% 0.430 0.270 - -28.95% -
464.h264ref (unexplained diff vs previous) -37.04% 27.000 17.000 - -70.69% -
410.bwaves (unexplained diff vs previous) -36.59% 41.000 26.000 - -89.88% -
410.bwaves (unexplained diff vs previous) (percentage) -36.23% 0.690 0.440 - -74.71% -
400.perlbench (unexplained diff vs previous) (percentage) -30.81% 1.720 1.190 - 283.87% -
400.perlbench (unexplained diff vs previous) -29.63% 27.000 19.000 - -45.71% -
471.omnetpp (max) -26.67% 30.000 22.000 - -87.21% -
403.gcc (max) -25.00% 4.000 3.000 - -94.23% -
471.omnetpp (max) (percentage) -24.76% 1.050 0.790 - -57.53% -
462.libquantum (max) (percentage) -16.54% 1.270 1.060 - 1225.00% -
436.cactusADM (max) -15.38% 13.000 11.000 - -99.11% -
436.cactusADM (max) (percentage) -12.00% 0.500 0.440 - -91.29% -
437.leslie3d (max) -11.10% 712.000 633.000 - 13.04% -
445.gobmk (unexplained diff vs previous) (percentage) -10.13% 0.790 0.710 - 373.33% -
400.perlbench (max) (percentage) -10.06% 1.690 1.520 - 90.00% -
445.gobmk (unexplained diff vs previous) -10.00% 40.000 36.000 - 100.00% -
437.leslie3d (max) (percentage) -9.93% 6.140 5.530 - 78.39% -
464.h264ref (max) (percentage) -9.09% 0.770 0.700 - 79.49% -
445.gobmk (max) (percentage) -8.97% 0.780 0.710 - 162.96% -
454.calculix (max) (percentage) -8.73% 4.240 3.870 - 360.71% -
447.dealII (max) -8.70% 23.000 21.000 - -86.00% -
456.hmmer (max) -8.70% 23.000 21.000 - -78.57% -
464.h264ref (max) -8.51% 47.000 43.000 - -27.12% -
403.gcc (max) (percentage) -8.37% 6.930 6.350 - 976.27% -
447.dealII (max) (percentage) -8.33% 1.200 1.100 - -33.33% -
456.hmmer (max) (percentage) -7.69% 0.520 0.480 - -7.69% -
400.perlbench (max) -7.69% 26.000 24.000 - -73.03% -
445.gobmk (max) -7.69% 39.000 36.000 - 9.09% -
453.povray (max) (percentage) -7.59% 1.450 1.340 - -48.26% -
450.soplex -5.88% 34.000 32.000 - -13.51% -
450.soplex (avg) -5.88% 34.000 32.000 - -13.51% -
444.namd -5.13% 39.000 37.000 - -91.06% -
444.namd (avg) -5.13% 39.000 37.000 - -91.06% -
435.gromacs -4.44% 270.000 258.000 - 61.25% -
435.gromacs (avg) -4.44% 270.000 258.000 - 61.25% -
447.dealII -4.35% 69.000 66.000 - -16.46% -
447.dealII (avg) -4.35% 69.000 66.000 - -16.46% -
433.milc -4.17% 48.000 46.000 - -51.06% -
433.milc (avg) -4.17% 48.000 46.000 - -51.06% -
401.bzip2 -4.07% 123.000 118.000 - 162.22% -
401.bzip2 (avg) -4.07% 123.000 118.000 - 162.22% -
429.mcf -4.05% 74.000 71.000 - 26.79% -
429.mcf (avg) -4.05% 74.000 71.000 - 26.79% -
437.leslie3d -3.94% 431.000 414.000 - 37.54% -
437.leslie3d (avg) -3.94% 431.000 414.000 - 37.54% -
435.gromacs (max) -3.91% 179.000 172.000 - -41.89% -
416.gamess -3.85% 364.000 350.000 - -27.84% -
416.gamess (avg) -3.85% 364.000 350.000 - -27.84% -
434.zeusmp -3.74% 107.000 103.000 - -59.61% -
434.zeusmp (avg) -3.74% 107.000 103.000 - -59.61% -
459.GemsFDTD (avg) (percentage) -3.71% 4.040 3.890 - 179.86% -
456.hmmer (avg) (percentage) -3.70% 2.430 2.340 - 680.00% -
456.hmmer -3.70% 108.000 104.000 - 85.71% -
456.hmmer (avg) -3.70% 108.000 104.000 - 85.71% -
436.cactusADM -3.67% 109.000 105.000 - -82.05% -
436.cactusADM (avg) -3.67% 109.000 105.000 - -82.05% -
416.gamess (avg) (percentage) -3.66% 2.460 2.370 - 43.64% -
401.bzip2 (avg) (percentage) -3.63% 4.130 3.980 - 1374.07% -
435.gromacs (avg) (percentage) -3.63% 3.580 3.450 - 263.16% -
447.dealII (avg) (percentage) -3.62% 3.590 3.460 - 297.70% -
471.omnetpp -3.60% 139.000 134.000 - 22.94% -
471.omnetpp (avg) -3.60% 139.000 134.000 - 22.94% -
434.zeusmp (avg) (percentage) -3.58% 3.910 3.770 - 209.02% -
481.wrf (max) -3.57% 84.000 81.000 - -91.14% -
471.omnetpp (avg) (percentage) -3.50% 4.860 4.690 - 297.46% -
433.milc (avg) (percentage) -3.49% 4.300 4.150 - 501.45% -
459.GemsFDTD -3.45% 290.000 280.000 - -20.45% -
459.GemsFDTD (avg) -3.45% 290.000 280.000 - -20.45% -
444.namd (avg) (percentage) -3.43% 4.370 4.220 - 62.31% -
435.gromacs (max) (percentage) -3.36% 2.380 2.300 - 30.68% -
410.bwaves -3.35% 209.000 202.000 - -30.10% -
410.bwaves (avg) -3.35% 209.000 202.000 - -30.10% -
436.cactusADM (avg) (percentage) -3.33% 4.200 4.060 - 69.17% -
453.povray (avg) (percentage) -3.28% 3.960 3.830 - 150.33% -
465.tonto (max) -3.26% 92.000 89.000 - -60.09% -
464.h264ref (avg) (percentage) -3.19% 2.820 2.730 - 600.00% -
410.bwaves (avg) (percentage) -3.13% 3.510 3.400 - 73.47% -
429.mcf (max) -3.08% 130.000 126.000 - 240.54% -
470.lbm (avg) (percentage) -3.07% 4.880 4.730 - 26.81% -
429.mcf (avg) (percentage) -3.03% 7.920 7.680 - 1500.00% -
458.sjeng -3.01% 166.000 161.000 - 347.22% -
458.sjeng (avg) -3.01% 166.000 161.000 - 347.22% -
459.GemsFDTD (max) (percentage) -2.97% 1.010 0.980 - -57.02% -
464.h264ref -2.86% 175.000 170.000 - 188.14% -
464.h264ref (avg) -2.86% 175.000 170.000 - 188.14% -
445.gobmk (avg) (percentage) -2.83% 2.470 2.400 - 990.91% -
465.tonto (max) (percentage) -2.82% 0.710 0.690 - -59.65% -
462.libquantum (avg) (percentage) -2.79% 3.590 3.490 - 1736.84% -
458.sjeng (avg) (percentage) -2.78% 2.160 2.100 - 813.04% -
459.GemsFDTD (max) -2.78% 72.000 70.000 - -87.89% -
470.lbm -2.76% 181.000 176.000 - -71.05% -
470.lbm (avg) -2.76% 181.000 176.000 - -71.05% -
437.leslie3d (avg) (percentage) -2.69% 3.720 3.620 - 116.77% -
473.astar (avg) (percentage) -2.64% 3.030 2.950 - 637.50% -
445.gobmk -2.40% 125.000 122.000 - 351.85% -
445.gobmk (avg) -2.40% 125.000 122.000 - 351.85% -
450.soplex (avg) (percentage) -2.34% 5.550 5.420 - 2158.33% -
400.perlbench (avg) (percentage) -2.31% 3.460 3.380 - 766.67% -
481.wrf (max) (percentage) -2.26% 1.330 1.300 - -68.75% -
429.mcf (max) (percentage) -2.01% 13.900 13.620 - 4156.25% -
482.sphinx3 (avg) (percentage) -1.89% 4.760 4.670 - 98.72% -
400.perlbench -1.85% 54.000 53.000 - 23.26% -
400.perlbench (avg) -1.85% 54.000 53.000 - 23.26% -
473.astar -1.37% 146.000 144.000 - 182.35% -
473.astar (avg) -1.37% 146.000 144.000 - 182.35% -
481.wrf -1.17% 257.000 254.000 - -55.04% -
481.wrf (avg) -1.17% 257.000 254.000 - -55.04% -
483.xalancbmk (max) (percentage) -1.09% 1.830 1.810 - 96.74% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) (percentage) 4156.25% 0.320 13.620 - -2.01% -
450.soplex (avg) (percentage) 2158.33% 0.240 5.420 - -2.34% -
462.libquantum (avg) (percentage) 1736.84% 0.190 3.490 - -2.79% -
429.mcf (avg) (percentage) 1500.00% 0.480 7.680 - -3.03% -
401.bzip2 (avg) (percentage) 1374.07% 0.270 3.980 - -3.63% -
462.libquantum (max) (percentage) 1225.00% 0.080 1.060 - -16.54% -
429.mcf (unexplained diff vs previous) (percentage) 1211.11% 0.090 1.180 - 84.37% -
450.soplex (max) (percentage) 1100.00% 0.440 5.280 - -38.17% -
445.gobmk (avg) (percentage) 990.91% 0.220 2.400 - -2.83% -
403.gcc (max) (percentage) 976.27% 0.590 6.350 - -8.37% -
458.sjeng (avg) (percentage) 813.04% 0.230 2.100 - -2.78% -
400.perlbench (avg) (percentage) 766.67% 0.390 3.380 - -2.31% -
456.hmmer (avg) (percentage) 680.00% 0.300 2.340 - -3.70% -
462.libquantum (unexplained diff vs previous) (percentage) 675.00% 0.080 0.620 - -50.40% -
473.astar (avg) (percentage) 637.50% 0.400 2.950 - -2.64% -
464.h264ref (avg) (percentage) 600.00% 0.390 2.730 - -3.19% -
433.milc (avg) (percentage) 501.45% 0.690 4.150 - -3.49% -
401.bzip2 (max) (percentage) 487.50% 0.400 2.350 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 393.18% 0.440 2.170 - -60.90% -
445.gobmk (unexplained diff vs previous) (percentage) 373.33% 0.150 0.710 - -10.13% -
454.calculix (max) (percentage) 360.71% 0.840 3.870 - -8.73% -
445.gobmk 351.85% 27.000 122.000 - -2.40% -
445.gobmk (avg) 351.85% 27.000 122.000 - -2.40% -
458.sjeng 347.22% 36.000 161.000 - -3.01% -
458.sjeng (avg) 347.22% 36.000 161.000 - -3.01% -
403.gcc (avg) (percentage) 316.28% 0.430 1.790 - -0.56% -
447.dealII (avg) (percentage) 297.70% 0.870 3.460 - -3.62% -
471.omnetpp (avg) (percentage) 297.46% 1.180 4.690 - -3.50% -
400.perlbench (unexplained diff vs previous) (percentage) 283.87% 0.310 1.190 - -30.81% -
435.gromacs (avg) (percentage) 263.16% 0.950 3.450 - -3.63% -
429.mcf (max) 240.54% 37.000 126.000 - -3.08% -
434.zeusmp (avg) (percentage) 209.02% 1.220 3.770 - -3.58% -
403.gcc (unexplained diff vs previous) (percentage) 201.72% 0.580 1.750 - 0.00% -
464.h264ref 188.14% 59.000 170.000 - -2.86% -
464.h264ref (avg) 188.14% 59.000 170.000 - -2.86% -
473.astar 182.35% 51.000 144.000 - -1.37% -
473.astar (avg) 182.35% 51.000 144.000 - -1.37% -
459.GemsFDTD (avg) (percentage) 179.86% 1.390 3.890 - -3.71% -
454.calculix (avg) (percentage) 165.02% 2.030 5.380 - 0.00% -
445.gobmk (max) (percentage) 162.96% 0.270 0.710 - -8.97% -
401.bzip2 162.22% 45.000 118.000 - -4.07% -
401.bzip2 (avg) 162.22% 45.000 118.000 - -4.07% -
473.astar (max) (percentage) 157.45% 0.470 1.210 - 0.00% -
453.povray (avg) (percentage) 150.33% 1.530 3.830 - -3.28% -
437.leslie3d (avg) (percentage) 116.77% 1.670 3.620 - -2.69% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
445.gobmk (unexplained diff vs previous) 100.00% 18.000 36.000 - -10.00% -
482.sphinx3 (avg) (percentage) 98.72% 2.350 4.670 - -1.89% -
483.xalancbmk (max) (percentage) 96.74% 0.920 1.810 - -1.09% -
473.astar (unexplained diff vs previous) (percentage) 95.74% 0.470 0.920 - 15.00% -
400.perlbench (max) (percentage) 90.00% 0.800 1.520 - -10.06% -
456.hmmer 85.71% 56.000 104.000 - -3.70% -
456.hmmer (avg) 85.71% 56.000 104.000 - -3.70% -
464.h264ref (max) (percentage) 79.49% 0.390 0.700 - -9.09% -
437.leslie3d (max) (percentage) 78.39% 3.100 5.530 - -9.93% -
410.bwaves (avg) (percentage) 73.47% 1.960 3.400 - -3.13% -
436.cactusADM (avg) (percentage) 69.17% 2.400 4.060 - -3.33% -
444.namd (avg) (percentage) 62.31% 2.600 4.220 - -3.43% -
435.gromacs 61.25% 160.000 258.000 - -4.44% -
435.gromacs (avg) 61.25% 160.000 258.000 - -4.44% -
481.wrf (avg) (percentage) 57.59% 2.570 4.050 - 0.00% -
416.gamess (avg) (percentage) 43.64% 1.650 2.370 - -3.66% -
437.leslie3d 37.54% 301.000 414.000 - -3.94% -
437.leslie3d (avg) 37.54% 301.000 414.000 - -3.94% -
458.sjeng (max) (percentage) 33.33% 0.300 0.400 - 0.00% -
435.gromacs (max) (percentage) 30.68% 1.760 2.300 - -3.36% -
470.lbm (avg) (percentage) 26.81% 3.730 4.730 - -3.07% -
429.mcf 26.79% 56.000 71.000 - -4.05% -
429.mcf (avg) 26.79% 56.000 71.000 - -4.05% -
400.perlbench 23.26% 43.000 53.000 - -1.85% -
400.perlbench (avg) 23.26% 43.000 53.000 - -1.85% -
471.omnetpp 22.94% 109.000 134.000 - -3.60% -
471.omnetpp (avg) 22.94% 109.000 134.000 - -3.60% -
437.leslie3d (unexplained diff vs previous) (percentage) 21.36% 1.030 1.250 - -80.77% -
458.sjeng (unexplained diff vs previous) (percentage) 16.67% 0.300 0.350 - 3400.00% -
437.leslie3d (max) 13.04% 560.000 633.000 - -11.10% -
429.mcf (unexplained diff vs previous) 10.00% 10.000 11.000 - 83.33% -
445.gobmk (max) 9.09% 33.000 36.000 - -7.69% -
465.tonto (avg) (percentage) 8.77% 1.140 1.240 - 0.00% -
465.tonto 8.11% 148.000 160.000 - -0.62% -
465.tonto (avg) 8.11% 148.000 160.000 - -0.62% -
401.bzip2 (max) 4.48% 67.000 70.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -
nb_total_tests -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.80% 32491.000 64.000 - 0.00% -
403.gcc -99.36% 8890.000 57.000 - -1.72% -
462.libquantum -99.05% 17005.000 161.000 - 0.62% -
482.sphinx3 -97.42% 36586.000 943.000 - 2.28% -
450.soplex -96.18% 15709.000 600.000 - -2.12% -
444.namd -94.37% 15957.000 898.000 - -0.11% -
453.povray -92.49% 7395.000 555.000 - 0.91% -
429.mcf -92.06% 11727.000 931.000 - -1.17% -
433.milc -91.76% 13668.000 1126.000 - 0.09% -
436.cactusADM -89.31% 24396.000 2607.000 - 0.15% -
434.zeusmp -86.94% 20932.000 2734.000 - -0.36% -
400.perlbench -85.80% 11215.000 1593.000 - 1.21% -
401.bzip2 -82.41% 16971.000 2985.000 - 0.03% -
447.dealII -78.86% 9101.000 1924.000 - -0.41% -
470.lbm -77.07% 16312.000 3741.000 - 0.54% -
456.hmmer -76.50% 18995.000 4463.000 - -0.02% -
459.GemsFDTD -71.61% 25364.000 7200.000 - 0.19% -
481.wrf -71.39% 21991.000 6292.000 - -0.88% -
471.omnetpp -69.04% 9265.000 2868.000 - 0.10% -
473.astar -62.30% 12983.000 4895.000 - 0.93% -
410.bwaves -59.64% 14745.000 5951.000 - -0.44% -
464.h264ref -58.99% 15208.000 6237.000 - 0.27% -
445.gobmk -58.85% 12396.000 5101.000 - 0.71% -
435.gromacs -55.47% 16853.000 7505.000 - -0.49% -
458.sjeng -52.05% 16018.000 7680.000 - -0.35% -
416.gamess -49.64% 29409.000 14810.000 - -0.09% -
437.leslie3d -36.61% 18070.000 11454.000 - -1.23% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -99.89% 879.000 1.000 - -75.00% -
444.namd (unexplained diff vs previous) -99.88% 834.000 1.000 - -50.00% -
436.cactusADM (unexplained diff vs previous) -99.66% 1173.000 4.000 - -69.23% -
454.calculix -99.54% 659.000 3.000 - 0.00% -
454.calculix (avg) -99.54% 659.000 3.000 - 0.00% -
454.calculix (max) -99.26% 272.000 2.000 - 0.00% -
436.cactusADM (max) -99.11% 1231.000 11.000 - -15.38% -
456.hmmer (unexplained diff vs previous) -98.98% 98.000 1.000 - -80.00% -
433.milc (unexplained diff vs previous) -98.96% 96.000 1.000 - -80.00% -
401.bzip2 (unexplained diff vs previous) -98.55% 69.000 1.000 - -97.22% -
416.gamess (unexplained diff vs previous) -98.55% 896.000 13.000 - -61.76% -
482.sphinx3 (max) -98.18% 1152.000 21.000 - 16.67% -
482.sphinx3 (unexplained diff vs previous) -98.12% 1118.000 21.000 - 90.91% -
403.gcc (unexplained diff vs previous) -98.08% 52.000 1.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -97.90% 5.230 0.110 - -50.00% -
434.zeusmp (unexplained diff vs previous) -97.87% 470.000 10.000 - -41.18% -
470.lbm (max) -97.76% 893.000 20.000 - 42.86% -
459.GemsFDTD (unexplained diff vs previous) -97.60% 584.000 14.000 - 75.00% -
470.lbm (unexplained diff vs previous) -97.57% 822.000 20.000 - 33.33% -
403.gcc -97.37% 38.000 1.000 - 0.00% -
403.gcc (avg) -97.37% 38.000 1.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -97.05% 3.050 0.090 - -60.87% -
453.povray (unexplained diff vs previous) -97.04% 169.000 5.000 - 400.00% -
433.milc (max) -96.91% 97.000 3.000 - -78.57% -
436.cactusADM (unexplained diff vs previous) (percentage) -96.88% 4.810 0.150 - -70.00% -
444.namd (max) (percentage) -96.37% 5.510 0.200 - -61.54% -
453.povray (max) -96.34% 191.000 7.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -96.15% 0.520 0.020 - -81.82% -
434.zeusmp (max) -95.84% 481.000 20.000 - -64.29% -
471.omnetpp (unexplained diff vs previous) -95.16% 62.000 3.000 - -76.92% -
482.sphinx3 -94.88% 859.000 44.000 - 2.33% -
482.sphinx3 (avg) -94.88% 859.000 44.000 - 2.33% -
403.gcc (max) -94.23% 52.000 3.000 - -25.00% -
416.gamess (max) -93.50% 923.000 60.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -92.86% 14.000 1.000 - -50.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -92.68% 0.410 0.030 - -97.52% -
462.libquantum (max) -92.31% 13.000 1.000 - -50.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -91.74% 2.300 0.190 - 72.73% -
436.cactusADM (max) (percentage) -91.29% 5.050 0.440 - -12.00% -
481.wrf (max) -91.14% 914.000 81.000 - -3.57% -
444.namd -91.06% 414.000 37.000 - -5.13% -
444.namd (avg) -91.06% 414.000 37.000 - -5.13% -
470.lbm (max) (percentage) -90.15% 5.480 0.540 - 35.00% -
410.bwaves (unexplained diff vs previous) -89.88% 257.000 26.000 - -36.59% -
470.lbm (unexplained diff vs previous) (percentage) -89.48% 5.040 0.530 - 32.50% -
447.dealII (unexplained diff vs previous) -88.24% 68.000 8.000 - -65.22% -
459.GemsFDTD (max) -87.89% 578.000 70.000 - -2.78% -
435.gromacs (unexplained diff vs previous) -87.33% 292.000 37.000 - 42.31% -
471.omnetpp (max) -87.21% 172.000 22.000 - -26.67% -
433.milc (unexplained diff vs previous) (percentage) -87.14% 0.700 0.090 - -79.55% -
416.gamess (max) (percentage) -86.94% 3.140 0.410 - 0.00% -
410.bwaves (max) -86.15% 260.000 36.000 - -82.86% -
447.dealII (max) -86.00% 150.000 21.000 - -8.70% -
471.omnetpp (unexplained diff vs previous) (percentage) -85.07% 0.670 0.100 - -77.78% -
462.libquantum -84.38% 32.000 5.000 - 0.00% -
462.libquantum (avg) -84.38% 32.000 5.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -83.56% 2.250 0.370 - -40.32% -
436.cactusADM -82.05% 585.000 105.000 - -3.67% -
436.cactusADM (avg) -82.05% 585.000 105.000 - -3.67% -
453.povray -81.42% 113.000 21.000 - 0.00% -
453.povray (avg) -81.42% 113.000 21.000 - 0.00% -
450.soplex (unexplained diff vs previous) -81.16% 69.000 13.000 - -61.76% -
456.hmmer (max) -78.57% 98.000 21.000 - -8.70% -
410.bwaves (unexplained diff vs previous) (percentage) -74.71% 1.740 0.440 - -36.23% -
400.perlbench (max) -73.03% 89.000 24.000 - -7.69% -
435.gromacs (unexplained diff vs previous) (percentage) -71.68% 1.730 0.490 - 44.12% -
470.lbm -71.05% 608.000 176.000 - -2.76% -
470.lbm (avg) -71.05% 608.000 176.000 - -2.76% -
464.h264ref (unexplained diff vs previous) -70.69% 58.000 17.000 - -37.04% -
481.wrf (max) (percentage) -68.75% 4.160 1.300 - -2.26% -
434.zeusmp (max) (percentage) -66.96% 2.300 0.760 - -63.29% -
410.bwaves (max) (percentage) -64.97% 1.770 0.620 - -82.44% -
453.povray (unexplained diff vs previous) (percentage) -60.70% 2.290 0.900 - 400.00% -
465.tonto (max) -60.09% 223.000 89.000 - -3.26% -
465.tonto (max) (percentage) -59.65% 1.710 0.690 - -2.82% -
434.zeusmp -59.61% 255.000 103.000 - -3.74% -
434.zeusmp (avg) -59.61% 255.000 103.000 - -3.74% -
471.omnetpp (max) (percentage) -57.53% 1.860 0.790 - -24.76% -
459.GemsFDTD (max) (percentage) -57.02% 2.280 0.980 - -2.97% -
450.soplex (max) -55.07% 69.000 31.000 - -40.38% -
481.wrf -55.04% 565.000 254.000 - -1.17% -
481.wrf (avg) -55.04% 565.000 254.000 - -1.17% -
433.milc (max) (percentage) -53.52% 0.710 0.330 - -75.00% -
433.milc -51.06% 94.000 46.000 - -4.17% -
433.milc (avg) -51.06% 94.000 46.000 - -4.17% -
453.povray (max) (percentage) -48.26% 2.590 1.340 - -7.59% -
400.perlbench (unexplained diff vs previous) -45.71% 35.000 19.000 - -29.63% -
447.dealII (unexplained diff vs previous) (percentage) -44.00% 0.750 0.420 - -64.71% -
458.sjeng (unexplained diff vs previous) -43.75% 48.000 27.000 - 2600.00% -
435.gromacs (max) -41.89% 296.000 172.000 - -3.91% -
458.sjeng (max) -37.50% 48.000 30.000 - 0.00% -
447.dealII (max) (percentage) -33.33% 1.650 1.100 - -8.33% -
410.bwaves -30.10% 289.000 202.000 - -3.35% -
410.bwaves (avg) -30.10% 289.000 202.000 - -3.35% -
464.h264ref (unexplained diff vs previous) (percentage) -28.95% 0.380 0.270 - -37.21% -
416.gamess -27.84% 485.000 350.000 - -3.85% -
416.gamess (avg) -27.84% 485.000 350.000 - -3.85% -
482.sphinx3 (max) (percentage) -27.62% 3.150 2.280 - 14.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -27.12% 3.060 2.230 - 87.39% -
464.h264ref (max) -27.12% 59.000 43.000 - -8.51% -
473.astar (unexplained diff vs previous) -26.23% 61.000 45.000 - 15.38% -
437.leslie3d (unexplained diff vs previous) -23.53% 187.000 143.000 - -81.03% -
459.GemsFDTD -20.45% 352.000 280.000 - -3.45% -
459.GemsFDTD (avg) -20.45% 352.000 280.000 - -3.45% -
447.dealII -16.46% 79.000 66.000 - -4.35% -
447.dealII (avg) -16.46% 79.000 66.000 - -4.35% -
450.soplex -13.51% 37.000 32.000 - -5.88% -
450.soplex (avg) -13.51% 37.000 32.000 - -5.88% -
456.hmmer (max) (percentage) -7.69% 0.520 0.480 - -7.69% -
473.astar (max) -3.28% 61.000 59.000 - 1.72% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1593.000 1.21%
401.bzip2 2985.000 -
403.gcc 57.000 -1.72%
410.bwaves 5951.000 -
416.gamess 14810.000 -
429.mcf 931.000 -1.17%
433.milc 1126.000 -
434.zeusmp 2734.000 -
435.gromacs 7505.000 -
436.cactusADM 2607.000 -
437.leslie3d 11454.000 -1.23%
444.namd 898.000 -
445.gobmk 5101.000 -
447.dealII 1924.000 -
450.soplex 600.000 -2.12%
453.povray 555.000 -
454.calculix 64.000 -
456.hmmer 4463.000 -
458.sjeng 7680.000 -
459.GemsFDTD 7200.000 -
462.libquantum 161.000 -
464.h264ref 6237.000 -
465.tonto 12979.000 -
470.lbm 3741.000 -
471.omnetpp 2868.000 -
473.astar 4895.000 -
481.wrf 6292.000 -
482.sphinx3 943.000 2.28%
Geometric Mean 2177.112 -
Code Size (bytes)
Name Current %
400.perlbench 563490.000 -
401.bzip2 33660.000 -
403.gcc 1589886.000 -
410.bwaves 14722.000 -
416.gamess 4554136.000 -
429.mcf 7709.000 -
433.milc 47493.000 -
434.zeusmp 140952.000 -
435.gromacs 394002.000 -
436.cactusADM 257008.000 -
437.leslie3d 48001.000 -
444.namd 162770.000 -
445.gobmk 1088240.000 -
447.dealII 191588.000 -
450.soplex 135600.000 -
453.povray 488845.000 -
454.calculix 682283.000 -
456.hmmer 74969.000 -
458.sjeng 81189.000 -
459.GemsFDTD 195934.000 -
462.libquantum 13074.000 -
464.h264ref 301398.000 -
465.tonto 1435824.000 -
470.lbm 10845.000 -
471.omnetpp 295673.000 -
473.astar 15549.000 -
481.wrf 1539888.000 -
482.sphinx3 80058.000 -
Geometric Mean 157307.351 -
sample variability
Name Current %
400.perlbench 53.000 -1.85%
400.perlbench (avg) 53.000 -1.85%
400.perlbench (avg) (percentage) 3.380 -2.31%
400.perlbench (max) 24.000 -7.69%
400.perlbench (max) (percentage) 1.520 -10.06%
400.perlbench (unexplained diff vs previous) 19.000 -29.63%
400.perlbench (unexplained diff vs previous) (percentage) 1.190 -30.81%
401.bzip2 118.000 -4.07%
401.bzip2 (avg) 118.000 -4.07%
401.bzip2 (avg) (percentage) 3.980 -3.63%
401.bzip2 (max) 70.000 -
401.bzip2 (max) (percentage) 2.350 -
401.bzip2 (unexplained diff vs previous) 1.000 -97.22%
401.bzip2 (unexplained diff vs previous) (percentage) 0.030 -97.52%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 1.790 -
403.gcc (max) 3.000 -25.00%
403.gcc (max) (percentage) 6.350 -8.37%
403.gcc (unexplained diff vs previous) 1.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.750 -
410.bwaves 202.000 -3.35%
410.bwaves (avg) 202.000 -3.35%
410.bwaves (avg) (percentage) 3.400 -3.13%
410.bwaves (max) 36.000 -82.86%
410.bwaves (max) (percentage) 0.620 -82.44%
410.bwaves (unexplained diff vs previous) 26.000 -36.59%
410.bwaves (unexplained diff vs previous) (percentage) 0.440 -36.23%
416.gamess 350.000 -3.85%
416.gamess (avg) 350.000 -3.85%
416.gamess (avg) (percentage) 2.370 -3.66%
416.gamess (max) 60.000 -
416.gamess (max) (percentage) 0.410 -
416.gamess (unexplained diff vs previous) 13.000 -61.76%
416.gamess (unexplained diff vs previous) (percentage) 0.090 -60.87%
429.mcf 71.000 -4.05%
429.mcf (avg) 71.000 -4.05%
429.mcf (avg) (percentage) 7.680 -3.03%
429.mcf (max) 126.000 -3.08%
429.mcf (max) (percentage) 13.620 -2.01%
429.mcf (unexplained diff vs previous) 11.000 83.33%
429.mcf (unexplained diff vs previous) (percentage) 1.180 84.37%
433.milc 46.000 -4.17%
433.milc (avg) 46.000 -4.17%
433.milc (avg) (percentage) 4.150 -3.49%
433.milc (max) 3.000 -78.57%
433.milc (max) (percentage) 0.330 -75.00%
433.milc (unexplained diff vs previous) 1.000 -80.00%
433.milc (unexplained diff vs previous) (percentage) 0.090 -79.55%
434.zeusmp 103.000 -3.74%
434.zeusmp (avg) 103.000 -3.74%
434.zeusmp (avg) (percentage) 3.770 -3.58%
434.zeusmp (max) 20.000 -64.29%
434.zeusmp (max) (percentage) 0.760 -63.29%
434.zeusmp (unexplained diff vs previous) 10.000 -41.18%
434.zeusmp (unexplained diff vs previous) (percentage) 0.370 -40.32%
435.gromacs 258.000 -4.44%
435.gromacs (avg) 258.000 -4.44%
435.gromacs (avg) (percentage) 3.450 -3.63%
435.gromacs (max) 172.000 -3.91%
435.gromacs (max) (percentage) 2.300 -3.36%
435.gromacs (unexplained diff vs previous) 37.000 42.31%
435.gromacs (unexplained diff vs previous) (percentage) 0.490 44.12%
436.cactusADM 105.000 -3.67%
436.cactusADM (avg) 105.000 -3.67%
436.cactusADM (avg) (percentage) 4.060 -3.33%
436.cactusADM (max) 11.000 -15.38%
436.cactusADM (max) (percentage) 0.440 -12.00%
436.cactusADM (unexplained diff vs previous) 4.000 -69.23%
436.cactusADM (unexplained diff vs previous) (percentage) 0.150 -70.00%
437.leslie3d 414.000 -3.94%
437.leslie3d (avg) 414.000 -3.94%
437.leslie3d (avg) (percentage) 3.620 -2.69%
437.leslie3d (max) 633.000 -11.10%
437.leslie3d (max) (percentage) 5.530 -9.93%
437.leslie3d (unexplained diff vs previous) 143.000 -81.03%
437.leslie3d (unexplained diff vs previous) (percentage) 1.250 -80.77%
444.namd 37.000 -5.13%
444.namd (avg) 37.000 -5.13%
444.namd (avg) (percentage) 4.220 -3.43%
444.namd (max) 1.000 -75.00%
444.namd (max) (percentage) 0.200 -61.54%
444.namd (unexplained diff vs previous) 1.000 -50.00%
444.namd (unexplained diff vs previous) (percentage) 0.110 -50.00%
445.gobmk 122.000 -2.40%
445.gobmk (avg) 122.000 -2.40%
445.gobmk (avg) (percentage) 2.400 -2.83%
445.gobmk (max) 36.000 -7.69%
445.gobmk (max) (percentage) 0.710 -8.97%
445.gobmk (unexplained diff vs previous) 36.000 -10.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.710 -10.13%
447.dealII 66.000 -4.35%
447.dealII (avg) 66.000 -4.35%
447.dealII (avg) (percentage) 3.460 -3.62%
447.dealII (max) 21.000 -8.70%
447.dealII (max) (percentage) 1.100 -8.33%
447.dealII (unexplained diff vs previous) 8.000 -65.22%
447.dealII (unexplained diff vs previous) (percentage) 0.420 -64.71%
450.soplex 32.000 -5.88%
450.soplex (avg) 32.000 -5.88%
450.soplex (avg) (percentage) 5.420 -2.34%
450.soplex (max) 31.000 -40.38%
450.soplex (max) (percentage) 5.280 -38.17%
450.soplex (unexplained diff vs previous) 13.000 -61.76%
450.soplex (unexplained diff vs previous) (percentage) 2.170 -60.90%
453.povray 21.000 -
453.povray (avg) 21.000 -
453.povray (avg) (percentage) 3.830 -3.28%
453.povray (max) 7.000 -
453.povray (max) (percentage) 1.340 -7.59%
453.povray (unexplained diff vs previous) 5.000 400.00%
453.povray (unexplained diff vs previous) (percentage) 0.900 400.00%
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 5.380 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 3.870 -8.73%
456.hmmer 104.000 -3.70%
456.hmmer (avg) 104.000 -3.70%
456.hmmer (avg) (percentage) 2.340 -3.70%
456.hmmer (max) 21.000 -8.70%
456.hmmer (max) (percentage) 0.480 -7.69%
456.hmmer (unexplained diff vs previous) 1.000 -80.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.020 -81.82%
458.sjeng 161.000 -3.01%
458.sjeng (avg) 161.000 -3.01%
458.sjeng (avg) (percentage) 2.100 -2.78%
458.sjeng (max) 30.000 -
458.sjeng (max) (percentage) 0.400 -
458.sjeng (unexplained diff vs previous) 27.000 2600.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.350 3400.00%
459.GemsFDTD 280.000 -3.45%
459.GemsFDTD (avg) 280.000 -3.45%
459.GemsFDTD (avg) (percentage) 3.890 -3.71%
459.GemsFDTD (max) 70.000 -2.78%
459.GemsFDTD (max) (percentage) 0.980 -2.97%
459.GemsFDTD (unexplained diff vs previous) 14.000 75.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.190 72.73%
462.libquantum 5.000 -
462.libquantum (avg) 5.000 -
462.libquantum (avg) (percentage) 3.490 -2.79%
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 1.060 -16.54%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.620 -50.40%
464.h264ref 170.000 -2.86%
464.h264ref (avg) 170.000 -2.86%
464.h264ref (avg) (percentage) 2.730 -3.19%
464.h264ref (max) 43.000 -8.51%
464.h264ref (max) (percentage) 0.700 -9.09%
464.h264ref (unexplained diff vs previous) 17.000 -37.04%
464.h264ref (unexplained diff vs previous) (percentage) 0.270 -37.21%
465.tonto 160.000 -
465.tonto (avg) 160.000 -
465.tonto (avg) (percentage) 1.240 -
465.tonto (max) 89.000 -3.26%
465.tonto (max) (percentage) 0.690 -2.82%
470.lbm 176.000 -2.76%
470.lbm (avg) 176.000 -2.76%
470.lbm (avg) (percentage) 4.730 -3.07%
470.lbm (max) 20.000 42.86%
470.lbm (max) (percentage) 0.540 35.00%
470.lbm (unexplained diff vs previous) 20.000 33.33%
470.lbm (unexplained diff vs previous) (percentage) 0.530 32.50%
471.omnetpp 134.000 -3.60%
471.omnetpp (avg) 134.000 -3.60%
471.omnetpp (avg) (percentage) 4.690 -3.50%
471.omnetpp (max) 22.000 -26.67%
471.omnetpp (max) (percentage) 0.790 -24.76%
471.omnetpp (unexplained diff vs previous) 3.000 -76.92%
471.omnetpp (unexplained diff vs previous) (percentage) 0.100 -77.78%
473.astar 144.000 -1.37%
473.astar (avg) 144.000 -1.37%
473.astar (avg) (percentage) 2.950 -2.64%
473.astar (max) 59.000 1.72%
473.astar (max) (percentage) 1.210 -
473.astar (unexplained diff vs previous) 45.000 15.38%
473.astar (unexplained diff vs previous) (percentage) 0.920 15.00%
481.wrf 254.000 -1.17%
481.wrf (avg) 254.000 -1.17%
481.wrf (avg) (percentage) 4.050 -
481.wrf (max) 81.000 -3.57%
481.wrf (max) (percentage) 1.300 -2.26%
482.sphinx3 44.000 2.33%
482.sphinx3 (avg) 44.000 2.33%
482.sphinx3 (avg) (percentage) 4.670 -1.89%
482.sphinx3 (max) 21.000 16.67%
482.sphinx3 (max) (percentage) 2.280 14.00%
482.sphinx3 (unexplained diff vs previous) 21.000 90.91%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.230 87.39%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.810 -1.09%
Geometric Mean 7.922 -19.06%